MAT. 

^^SSIER 



(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCX) 



(19) Worid Intellectual Property Organizatioii 

International Bureau 

(43) International Publication Date 
23 October 2003 (23.10.2003) 




PCX 



ittHiiiiiiiniiiiiiiiiiiiiiiiiiiiini 

(10) International Publication Number 

wo 03/088203 Al 



(51) International Patent Classification'': 
(21) International Application Number: 



G09G5/02 



PCT/IL03/00307 



(22) International Filing Date: 13 April 2003 (13.04.2003) 



(25) Filing Language: 

(26) Publication Language: 

(30) Priority Data: 

60/371,419 



English 
English 



1 1 April 2002 ( 1 1 .04.2002) US 



(71) Applicant (for AE, AG, AL, AM, AT, AU, AZ, BA, BB, BE, 
BG, BR, BY, BZ, CA, CH, CN, CO, CR, CU, CY, CZ, DK, 
DM, DZ, EC. EE, ES, Fl, FR, GB, GD, GE, GH, GM, GK 
HR, HU, ID, IE, IL, IN, IS, FT, KE, KG, KP, KR, KZ, LC, LK, 
LR, LS, LT, LU, LV, MA, MC, MD, MG, MK, MN, MW, MX, 
MZ, NI, NL, NO, NZ, OM, PH, PL, PT, RO, RU, SC, SD. SE, 
SG, SK, SL, SZ, TJ, TM, TN, TR, TT, TZ, UA, UG, UZ, VC, 
VN, YU, ZA, ZM, ZW only): GENOA COLOR TECH- 
NOLOGIES LTD. [GB/GB]; Trident Chambers, P.O. Box 
146, Road Town, Tortola (VG). 

(71) Applicants and 

(72) Inventors (ftv DE, JF, US only): ROTH, Shmuel [IL/IL]; 
7 Zelig Bas Street, 49550 Petach Tikva (IL). BEN-DAVID, 
Han [IL/IL]; 55 Hapa'amon Street, 48611 Rosh Ha'ayin 
(IL). BEN-CHORIN, Moshe [II7IL]; 34 Ya^kov Street, 
76262 Rehovot (IL). ELIAV, Dan [lUIL]; 9 Odem Street, 
30900 Zichron Yaakov (IL). 



(74) Agents: EITAN, PEARL, LATZER & CO- 
HEN-ZEDEK et al.; 2 Gav Yam Center, 7 Shenkar 
Street. 46725 Herzlia (IL). 

(81) Designated States (national): AE, AG, AL, AM, AT, AU, 
AZ, BA, BB, BG, BR, BY, BZ, CA, CH, CN, CO, CR, CU, 
CZ, DE, DK, DM, DZ, EC, EE, ES, FI, GB, GD, GE, GH, 
GM, HR, HU, ID, IL, IN, IS, JP, KE, KG, KP, KR, KZ, LC, 
LK, LR, LS, LT, LU, LV, MA, MD, MG, MK, MN, MW, 
MX, MZ, NI, NO, NZ, OM, PH, PL, PT, RO, RU, SC, SD, 
SE, SG, SK, SL, TJ, TM, TN, TR, TT, TZ, UA, UG, US, 
UZ. VC. VN, YU, ZA, ZM, ZW. 

(84) Designated States (regional): ARIPO patent (GH, GM, 
KE, LS. MW, MZ, SD, SL, SZ, TZ, UG, ZM, ZW), 
Eraasian patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), 
European patent (AT, BE, BG, CH, CY, CZ, DE, DK, EE, 
ES. FI, FR, GB, GR, HU, IE, IT, LU, MC, NL, PT, RO, 
SE, SI. SK, TR), OAPI patent (BF, BJ, CF, CG, CI, CM, 
GA, GN, GQ, GW, ML, MR, NE, SN, TD, TG). 

Published: 

— with international search report 

— before the expiration of the time limit for amending the 
claims and to be republished in the event cf receipt of 
amendments 

For two-letter codes and other abbreviations, refer to the "Guid- 
ance Notes on Codes and Abbreviations" appearing at the begin- 
ning of each regular issue of the PCT Gazette. 



(54) Title: COLOR DISPLAY DEVICES AND METHODS WITH ENHANCED ATTRIBUTES 



Input 
Data 



= (RGB, YCC) 

< 

00 
00 



n-primaries 
Controller 

-T — - 

218 



220 



Driivers 



216 



214 




212 



(57) Abstract: A color display device for displasnng an n-primary color image, wherein n is greater than three, the device including 
an array of sub-pixels (801) configured to have at least one repeating unit having one sub-pixel representing each of the n primary 
colors, wherein the repeating unit (906) is configured to optimize at least one attribute of the n-primary color image. 



BNSDOCID: <WO ^03088203A1 J_> 



wo 03/088203 



PCT/IL03/00307 



ft 

♦ 



COLOR DISPLAY DEVICES AHfP METHODS WITH ENHANCED 

ATTRIBUTES 

5 FIELD OF THE INVENTION 

The invention relates generally to color display devices, systems and methods 
and, more particularly, to display devices, systems and methods having improved color 
image reproduction capability. 

10 BACKGROUND OF THE INVENTION 

Standard computer monitors and TV displays are typically based on reproduction 
of three, additive, primary colors (''primaries"), for example, red, green, and blue, 
collectively referred to as RGB. Unfortunately, these monitors cannot display many 
colors perceived by humans, since they are limited in the range of color they are capable 

15 of displaying. Fig. lA schematically illustrates a chromaticity diagram as is knoAvn in 
the art. The closed area in the sh^e of a horseshoe represents the chromaticity range of 
colors that can be seen by humans. However, chromaticity alone does not fully represent 
all visible color variations. For example, each chromaticity value on the 
two-dimensional chromaticity plane of Fig. lA may be reproduced at varioiis different 

20 brightness levels. Thus, a fiill representation of the visible color space requires a three 
dimensional space including, for example, two coordiaates representing chromaticity 
and a third coordinate representing brightness. Other three dimensional space 
representations may also be defined. The points at the border of the horseshoe diagram 
in Fig. lA, commonly referred to as "spectrum locus", correspond to monochromatic 

25 excitations at wavelengths ranging, for example, from 400 nm to 780 ran. The straight 
line "closing" the bottom of the horseshoe, between the extreme monochromatic 
excitation at the longest and shortest wavelengths, is commonly referred to as *the 
pmple line". The range of colors discernible by the human eye, represented by the area 
of the horseshoe diagram above the purple line, at varying brightness levels, is 

30 commonly referred to as the color gamut of the eye. The dotted triangular area of Fig. 
1 A represents the range of colors that are reproducible by a standard RGB monitor. 

1 
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There are many known iypes of RGB monitors, using various diqjlay 
technologies, mcluding but not limited to CRT, LED, plasma, projection displays, LCD 
devices and others. Over the past few years, the use of color LCD devices has been 
increasing steadily. A typical color LCD device is schematically illustrated in Fig. 2A. 
5 Such a device includes a light source 202, an airay of liquid crystal (LC) elements (cells) 
204, for example, an LC array using Thin Film Transistor (TFT) active-matrix 
technology, as is known in the art. Tlie device fiirther includes electronic circuits 21 0 for 
driving the LC array cells, e.g., by active-matrix addressing, as is known in the art, and a 
tri-color filter array, e.g., a RGB filter array 206, juxtaposed the LC array. In existing 

10 LCD devices, each full-color pixel of the displayed image is reproduced by three 
sub-pixels, each sub-pixel corresponding to a different primary color, e.g., each pixel is 
reproduced by driving a respective set of R, G and B sub-pixels. For each sub-pixel 
there is a corresponding cell in the LC array. Back-illumination source 202 provides the 
light needed to produce tiie color images. The transmittance of each of the sub-pixels is 

15 controlled by the voltage applied to the corresponding LC cell, based on the RGB data 
input for the corresponding pixel. A controller 208 receives the input RGB data, scales it 
to the required size and resolution, and transmits data representing the magnitude of the 
signal to be delivered by the different drivers based on the input data for each pixel. The 
intensity of white light provided by the back-illumination source is spatially modulated 

20 by the LC array, selectively attenuating the li^t for each sub pixel according to the 
desired intensity of the sub-pixel. The selectively attenuated light passes through tiie 
RGB color filter array, wherein each LC cell is in registry with a corresponding color 
sub-pixel, producing the desired color sub-pixel combinations. The human vision system 
spatially integrates the light filtered through the different color sub-pixels to perceive a 

25 color image. 

US Patent 4,800,375 ('the '375 patent"), the disclosure of which is incorporated 
herein by reference in its entirety, describes an LCD device including an array of LC 
elements juxtaposed in registry with an array of color filters. The filter array includes tiie 
three primary color sub-pixel filters, e.g., RGB color filters, which are interlaced with a 
30 fourth type of color filter to form predetennined repetitive sequences. The various 
repetitive pixel arrangements described by the '375 patent, e.g., repetitive 16-pixel 
sequences, are intended to simplify pixel arrangement and to improve flie ability of the 
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display device to reproduce certain image patterns, e.g., more symmetrical line patterns. 
Other than controlling the geometric arrangement of pixels, the '375 patent does not 
describe or suggest any visual interaction between the three primary colors and the 
foxorth color in the repetitive sequences. 
5 LCDs are used in various applications. LCDs are particularly common in 

portable devices, for example, the small size displays of PDA devices, game consoles 
and mobile telephones, and the medium size displays of laptop ("notebook") computers. 
These applications require thin and miniaturized designs and low power consumption. 
However, LCD technology is also used in non-portable devices, generally requiring 

10 larger display sizes, for example, desktop computer displays and TV sets. Different 
LCD applications may require different LCD designs to achieve optimal results. The 
more ^traditional'' markets for LCD devices, e.g., the markets of battery-operated 
devices (e.g., PDA, cellular phones and laptop computers) require LCDs with high 
brightness efficiency, which leads to reduced power consumption. In desktop computer 

15 displays, high resolution, image quality and color richness are the primary 
considerations, and low power consumption is only a secondary consideration. Laptop 
computer displays require both high resolution and low power consxmaption; however, 
picture quality and color richness are compromised in many such devices. Li TV display 
applications, picture quality and color richness are generally the most important 

20 considerations; power consumption and high resolution are secondary considerations in 
such devices. 

Typically, the light source providing back-illumination to LCD devices is a Cold 
Cathode Fluorescent Light (CCFL). Fig. 3 schematically illustrates typical spectra of a 
CCFL, as is known in the art. As illustrated in Fig. 3, the light soxarce spectra include 

25 three, relatively narrow, dominant wavelength ranges, corresponding to red, green and 
blue light, respectively. Other suitable light sources, as are known in the art, may 
alternatively be used. The RGB filters in the filter sub-pixel array are typically designed 
to reproduce a sufficiently wide color gamut (e.g., as close as possible to the color gamut 
of a corresponding CRT monitor), but also to maximize the display efficiency, e.g., by 

30 selecting filters whose transmission curves generally overlap the CCFL spectra peaks in 
Fig. 3. In general, for a given source brightness, fiilters wth narrower transmission 
spectra provide a wider color gamut but a reduced display brightness, and vice versa. For 

3 
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example, in applications where power efficiency is a critical consideration, color gamut 
width may often be sacrificed. In certain TV applications, brightness is an important 
consideration; however, dull colors are not acceptable. 

Fig. 4A schematically illustrates typical RGB filter spectra of existing laptop 
5 computer displays. Fig. 4B schematically illustrates a chromaticity diagram representing 
the reproducible color gamut of the typical laptop spectra (dashed-triangular area in Fig. 
4B), as compared with an ideal NTSC color gamut (dotted triangular area in Fig. 4B). As 
shown in Fig. 4B, the NTSC color gamut is significantiy wider than the color gamut of 
the typical laptop computer display and therefore, many color combinations included in 
10 the NTSC gamut are not reproducible by the typical color laptop computer display, 

SUMMARY OF THE INVENTION 

Many colors seen by humans are not discernible on standard red-green-blue 
(RGB) monitors. By using a display device with more than three primary colors, the 

15 reproducible color gamut of the display is expanded. Additionally or alternatively, the 
brightness level produced by the display may be significantiy increased. Embodiments 
of the present invention provide systems and methods of displaying color images on a 
display device, for example, a thin profile display device, such as a Uquid crystal display 
(LCD) device, using more than three primary colors. 

20 Exemplary embodiments of an aspect of the invention provide improved 

miilti-primary display devices using more than three sub-pixels of different colors to 
create each pixel. In embodiments of this aspect of the invention, the use of four or more 
different color sub-pixels, per pixel, allows for a wider color gamut and higher luminous 
efiiciency. In some embodiments, the number of sub-pixels per pixel and the color 

25 spectra of the different sub-pixels may be optimized to obtain a desired combination of a 
siifficientiy wide color gamut, sufficientiy high brightness, and sufficiently high 
contrast. 

In some embodiments of the invention, the use of more than Ihree primary colors 
may expand the reproducible color gamut of the display by enabling the use of relatively 
30 narrow wavelength ranges for some of the primary colors, e.g,, red, green and blue, thus 
increasing the saturation of those primary colors. To compensate for a potentially 
reduced brightness level from such narrower ranges, in some embodiments of the 
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invention, broad wavelength range primary colors, e.g., specifically designed yellow 
and/or cyan, may be used in addition to the narrow wavelength range colors, thus 
increasing the overall brightness of the display. In further embodiments of the invention, 
additional primary colors (e.g., magenta) and/or different primary color spectra may be 
5 tised to improve various other aspects of the displayed image. In accordance with 
embodiments of the invention, an optimal combination of color gamut width and 
over-all display brightness can be achieved, to meet the requirements of a given system, 
by designing specific primary colors and sub-pixel arrangements. 

The color gamut and other attributes of a more-than-fhree primary color LCD 

10 device in accordance with embodiments of the invention may be controlled by 
controlling the spectral transmission characteristics of the different primary color 
sub-pbcel filter elements used by the device. According to an aspect the invention, four 
or more different primary color sub-pixel filters are used, to produce four or more, 
respective, primary colors, for example, RGB and yellow (Y). In further embodiments of 

15 the invention, at least five different primary color sub-pixel filters are used, for example, 
RGB, Y and cyan (C) filters, in additional embodimOTts of the invention, at least six 
different primary color sub-pixel filters are used, for example, RGB, Y, C and magenta 
(M) filters. 

The primary color sub-pixel filters for a more-than-three primary color LCD 
20 device in accordance with the invention may be selected in accordance with various 
criteria, for example, to establish sufficient coverage of a desired color gamut, to 
maximize the brightness level that can be produced by the display, and/or to adjiast the 
relative intensities of the primary colors according to a desired chromaticity standard. 

In accordance with embodiments of the invention, a mxilti-primary display with n 
25 primary colors may include an array of pixels, each pixel including n sub-pixels, 
wherein each sub-pixel has a predetermined aspect ratio, for example, n:l, which yields 
a desired aspect ratio, for example, 1:1, for each pixel. 

According to further embodiments of the invention, attributes of a multi-primary 
LCD display may be controlled and/or affected by specific arrangements of the n 
30 sub-pixels forming each pixel and/or specific arrangements of the pixels. Such attributes 
may include picture resolution, color gamut wideness, luminance uniformity and/or any 

5 



BNSDOCID: <WO 0308a203A1«L> 



wo 03/088203 PCT/IL03/00307 

Other display attribute that may depend on the arrangement of the pixels and/or 
sub-pixels. 

According to one exemplary embodiment of the invention, color saturation may 
be improved by arranging the n primary colors in the n sub-pixels forming each pixel 
5 based on a hue order of the n primary colors. 

According to another exemplary embodiment of the invention, optimal viev^ed 
image uniformity, e.g., optimally uxiifomi limiinance across the viev^ed image may be 
achieved by arranging the n primary color sub-pixels fomiing each pixel to yield a 
minimal variance in luminance between neighboring groups of sub-pixels. In some 

10 embodiments of the invention, the sub-pixel arrangement may be determined by 
mapping a plurality of sub-pixel arrangements, detemiining a luminance value of each 
mapped arrangement, transforming the luminance values from spatial coordinates to 
spatial frequencies, e.g., hamionics, for example, by appl3dng a Fomier Transform to the 
calculated luminance values, and minimizing the amplitude of a haraionic, e.g., the first 

1 5 harmonic, of the transformation. 

According to a further embodiment of the invention, the n primary sub-pixels are 
arranged within each pixel such that sub-sets of neighboring sub-pixels within the pixels 
have a relatively neutral white-balance. 

According to exemplary embodiments of another aspect of the invention, there is 

20 provided a system and method for n-primary sub-pixel rendering of a displayed graphic 
object, for example, a character having a certain font The method may enable 
modification of the viewed contour and/or edges of the displayed graphic, for example, 
to reduce a color fiiciges effect of the viewed object. The method may include sampling 
the graphic image, assigning each sub-pixel an initial coverage value, applying to each 

25 sub-pixel a smoothing ftinction, for example, calculating a weighted average of a 
neighboring group of sub-pixels, and assigning an adjusted coverage value to each 
sub-pixel in the group based on the values calculated by the smoothing function. 

According to exemplary embodiments of yet another aspect of the invention, the 
reproducible bit-depth of a more-than-three primary color display may be expanded, i.e., 

30 a wider span of gray-levels may be obtaine4 compared to the bit-depth of three primary 
color displays, by reproducing at least some colors wing combinations of only some of 
the primary color sub-pixels. This aspect of the invention may be advantageous in 

6 
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producing low gray-level pixels, because tiie variety of gray-levels may be particularly 
significant for the lower gray-levels. In some embodiments of this aspect of the 
invention, the gray-level of a pixel may be adjusted by adjusting the intensity of a 
sub-set of the n sub-pixels forming the pixel, for example, a sub-set capable of 
5 producing a substantially neutral white-balance. 

Brief Description Of The Drawings 

The invention will be understood and appreciated more fiilly from the following 
detailed description of embodiments of the invention, taken in conjunction with the 
10 accompanying drawings in which: 

Fig. 1 A is a schematic illustration of a chromaticity diagram representing a prior 
art RGB color gamut, superimposed with a chromaticity diagram of the color gamut of a 
human vision system, as is known in the art; 

Fig. IB is a schematic illustration of a chromaticity diagram representing a wide 
15 color gamut in accordance with an exemplary embodiment of the invention, 
superimposed with the chromaticity diagram of Fig. 1 A; 

Fig. 2A is a schematic block diagram illustrating a prior art 3-primary LCD 
system; 

Fig. 2B is a schematic block diagram illustrating an n-primary LCD system in 
20 accordance with an embodiment of the invention; 

Fig. 3 is a schematic graph illustrating typical spectra of a prior art Cold Caflxode 
Fluorescent Light (CCFL) source; 

Fig. 4A is a schematic graph illustrating typical RGB filter spectra of a prior art 
laptop computer display; 
25 Fig. 4B is a schematic illustration of a chromaticity diagram representing the 

color gamut reproduced by the prior art RGB filter spectra of Fig. 4A, superimposed 
with an ideal prior art NTSC color gamut; 

Fig. 5A is a schematic graph illustrating transmission curves of an exemplary, 
filter design for a five-primary display device in accordance with an embodiment of tibie 
30 invention; 
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Fig. 5B is a schematic illustration of a chromaticity diagram representing the 
color gamut of the filter design of Fig. 5A, superimposed with two exemplary prior art 
color gamut representations; 

Fig. 5C is a schematic graph illustrating transmission curves of another, 
5 exemplary, filter design for a five-primary display device in accordance with an 
embodiment of the invention; 

Fig. 5D is a schematic illustration of a chromaticity diagram representing the 
color gamut of the filter design of Fig. 5C, superimposed with two exemplary prior art 
color gamut representations; 
10 Fig. 6 is a schematic illustration of a chromaticity diagram of a human vision 

color gamut divided into a plurality of color sub-gamut regions; 

Figs. 7A, 7B and 7C are schematic illustrations of one-dimensional 
configurations of sub-pixels of an n-primary LCD display in accordance Avith exemplary 
embodiments of the invention; 
15 Figs. 7D and 7E are schematic illustrations of two-dimensional configurations of 

sub-pixels of an n-primary LCD display in accordance with exemplary embodiments of 
the invention; 

Figs. 8A and 8B are schematic illustrations of arrangements of primary colors in 
groups of sub-pixels based on hue order of the n primary colors, for a one-dimensional 
20 5-primary display and for a two-dimensional 4-primary display, respectively, in 
accordance with exemplary embodiments of the invention; 

Figs. 9A and 9B are schematic illustrations of prior art arrangements of 
sub-pixels in a RGB display; 

Fig. 9C is a schematic illustration of an arrangement of sub-pixels including a 
25 basic repeating unit having a one-dimensional 5-primary configuration in accordance 
with an exemplary embodiment of the invention; 

Fig. 10 is a schematic block-diagram illustration of a method for arranging n 
primary colors in groups of n sub-pixels of a LCD display in accordance with exemplary 
embodiments of the invention; 
30 Fig. IIA is a schematic illustration of an arrangement of primary colors in 

sub-pixels for a one-dimensional 5-primary display, in accordance with an exemplary 
embodiment of the invention; 



8 



BNSDOCID: <WO ^03088203A1_L> 



wo 03/088203 PCT/IL03/00307 

Fig. IIB is a schematic illustration of an arrangement of primary colors in 
sub-pixels for a two-dimensional 6-primary display, in accordance with an exemplary 
embodiment of the invention; 

Fig. lie is a schematic illustration of a chromaticity diagram representing tihe 
5 color gamut of a 5-primary display in accordance with an exemplary embodiment of the 
invention; 

Fig. 12A is a schematic illustration of an enlarged character rastered to black and 
white pixels according to prior art methods; 

Fig. 12B is a schematic illustration of aQ enlarged character rastered to gray-scale 
10 pixels according to prior art methods; 

Fig. 12C is a schematic illustration of an enlarged character rastered to RGB 
sub-pixels according to prior art methods; 

Fig. 1 2D is a schematic illustration of a character enlarged by an initial stage of 
n-primary sub-pixel rendering according to exemplary embodiments of the invention; 
1 5 Fig. 12E is a schematic illustration of a table showing initial coverage values that 

may be assigned to sub-pixels of the image of Fig. 12D based on an assignment method 
according to exemplary embodiments of the invention; 

Fig. 12F is a schematic illustration of a character enlarged and adjusted by 
sub-pixel rendering according to exemplary embodiments of the invention; 
20 Fig. 12G is a schematic illustration of a table showing adjusted cover^e values 

that may be assigned to sub-pixels of the image of Fig. 12F based on an assignment 
method according to exemplary embodiments of the invention; 

Fig. 13 A is a schematic block illustration of a method for miolti-primary 
sub-pixel rendering in accordance with exemplary embodiments of the invention; 
25 Fig. 13B is a schematic block illustration of data flow in a system of 

multi-primary sub-pixel rendering of a multi-primary display in accordance with 
exemplary embodiments of the invention; 

Fig. 14 is a schematic diagram of the flow of data in a LCD display system 
incorporating a method for increasing bit depth, in accordance with exemplary 
30 embodiments of the invention; and 
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Fig. 15 is a schematic illustration of a chromaticity diagram representing a color 
gamut of a 6-primary display in accordance with an exemplary embodiment of the 
invention. 
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Detailed Description Of Embodiments Of The Invention 

In the following description, various aspects of the invention are described, with 
reference to specijBc embodiments that provide a thorough understanding of the 
invention; however, it will be apparent to one skilled in the art that the present invention 
5 is not limited to the specific embodiments and examples described herein. Further, to 
the extent that certain details of the devices, systems and methods described herein are 
related to known aspects of color display devices, systems and methods, such details 
may have been omitted or simplified for clarity- 
Fig. IB schematically illustrates a color gamut of a more-than-three-piimary 

10 display in accordance with an embodiment of the invention, enclosed by a horseshoe 
diagram representing the perceivable color gamut of the himian eye, on a chromaticity 
plane. The six-sided shape in Fig. IB represents the color gamut of a six-primary display 
in accordance with an exemplary embodiment of the invention. This color gamut is 
significantly wider than a typical RGB color gamut, which is represented by the dotted 

15 triangular shape in Fig. IB. Embodiments of monitors and display devices with more 
than three primaries, in accordance with exemplary embodiments of the invention, are 
described in U.S. Patent Application No. 09/710,895, entitled "Device, System And 
Method For Electronic Tme Color Display'*, filed November 14, 2000, in International 
AppUcation PCT/ILOl/00527, filed June 7, 2001, entitled "Device, System and Method 

20 For Electronic True Color Display*' and published December 13, 2001 as PCX 
Publication WO 01/95544, in U.S. Patent Application No. 10/017,546, filed December 
18, 2001, entitled "Spectrally Matched Digital Print Proofer" and published October 17, 
2002 as US Publication US-2002-0 14954, in International AppUcation PCT/IL02/00410, 
filed May 23, 2002, entitled "System and method of data conversion for wide gamut 

25 displays" and published December 12, 2002 as PCT Publication WO 02/99557, and in 
Intemational Application PCT/IL02/00452, filed June 11, 2002, entitled "Device, 
System and Method For Color Display" and published December 19, 2002 as PCT 
Pubhcation WO02/101644, the disclosures of all of which applications and publications 
are incorporated herein by reference. 

30 While, in embodiments of the present invention, methods and systems disclosed 

—in the above referenced patent appUcations may be used, for example, methods of 
converting source data to primary data, or methods of creating primary color materials or 

11 
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jSlters; in alternate embodiments, the system and method of the present invention may be 
used with any other suitable n-primary display technology, wherein n is greater than 
three. Certain embodiments described in these applications are based on rear or front 
projection devices, CRT devices, or other types of display devices. While the following 
5 description focuses mainly on n-primaries flat panel display devices in accordance with 
exemplary embodiments of the invention, wherein n is greater than three, preferably 
using LCDs, it should be appreciated that, in alternate embodiments, the systems, 
methods and devices of the present invention may also be used in conjunction with other 
types of display and other types of light sources and modidation techniques. For 

10 example, it will be appreciated by persons skilled in the art that the principles of the 
n-primary color display device of the invention may be readily implemented, with 
appropriate changes, in CRT displays. Plasma display. Light Emitting Diode (LED) 
displays. Organic LED (OLED) displays and Field Emissions Display (FED) devices, or 
any hybrid combinations of such display devices, as are known in the art. 

15 Fig. 2B schematically illustrates a more-than-three primary color display system 

in accordance with an embodiment of the invention. The system includes a light source 
212, an array of liquid crystal (LC) elements (cells) 214, for example, an LC array using 
Tlun Film Transistor (TFT) active-matrix technology, as is known in the art. The device 
further includes electronic circuits 220 for driving the LC array cells, e.g., by 

20 active-matrix addressing, as is known in the art, and an n-primary-color filter array 216, 
wherein n is greater than three, juxtaposed the LC array. In embodiments of the LCD 
devices according to embodiments of the invention, each full-color pixel of the 
displayed image is reproduced by more than three sub-pixels, each sub-pixel 
corresponding to a different primary color, e.g., each pixel is reproduced by driving a 

25 corresponding set of four or more sub-pixels. For each sub-pixel there is a corresponding 
cell in LC array 214. Back-illimiination source 212 provides the light needed to produce 
the color images. The transmittance of each of the sub-pixels is controlled by the voltage 
applied to a corresponding LC cell of array 214, based on the image data input for the 
corresponding pixel. An n-primaries controller 218 receives the input data, e.g., in RGB | 

30 or YCC format, optionally scales the data to a desired size and resolution, and transmits 
data representing the -magnitude of &e signals to be delivered by the different drivers 
based on the input data for each pixel. The intensity of white light provided by 
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back-illumination source 212 is spatially modulated by elements of the LC array, 
selectively controlling the illumination of each sub-pixel according to the image data for 
the sub-pixeL The selectively attenuated light of each sub-pixel passes through a 
corresponding color jfilter of color filter array 216, thereby producing desired color 
5 sub-pixel combinations. The human vision system spatially integrates the light filtered 
through the different color sub-pixels to perceive a color image. 

The color gamut and other attributes of LCD devices in accordance with 
embodiments of the invention may be controlled by a number of parameters. These 
parariieters include: the spectra of the back illumination element (light source), for 

10 example a Cold Cathode Fluorescent Light (CCFL); the spectral transmission of the LC 
cells in the LC array; and the spectral transmission of the color filters. Li a 3 -primaries 
display, the first two parameters, namely, the spectra of the light som'ce and the spectral 
transmission of the LC cell, are typically dictated by system constraints and, therefore, 
the colors for the filters may be selected straightforwardly to provide the required 

15 colorimetric values at the "comers" of the desired RGB triangle, as shown in Fig. 1 A. To 
maximize the efl&ciency of 3-primaries LCD devices, the spectral transmissions of the 
filters are designed to substantially overlap, to the extent possible, with the wavelength 
peaks of the lig^t source. The filters selection in 3-primary LCD devices may be based 
primarily on maximizing the overall brightness efficiency. In this context, it should be 

20 noted that selecting filters having narrower spectral transmission curves, which result in 
more saturated primary colors, generally decreases the over-all brightness level of the 
display. 

For a multi-primary display with more than three primary colors, in accordance with 
embodiments of the invention, an infinite nimiber of filter combinations can be selected 

25 to substantially overlap a required color gamut. The filter selection method of the 
invention may include optimizing the filter selection according to the following 
requirements: establishing sufficient coverage of a desired two-dimensional color gamut, 
for example, the NTSC standard gamut for wide-gamut applications and a 
"conventional" 3-color LCD gamut for higher brightness applications; maximizing the 

30 brightness level of a balanced white point that can be obtained from combining all the 
primary colors; and adjusting the relative intensities of the primary colors in accordance 
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with a desired illumination standard, e.g., the D65 white point chromaticity standard of 
High Definition TV (HDTV) systems. 

Embodiments of the present invention provide systems and methods of 
displaying color images on a display device, for example, a thin profile display device, 
5 such as a liquid crystal display (LCD) device, using more than three primajry colors. A 
number of embodiments of the invention are described herein in the context of an LCD 
device with more than three primary colors; wherein the number of color filters used per 
pixel is greater than three. This arrangement has several advantages in comparison to 
conventional RGB display devices. First, the n-primary display device in accordance 

10 with the invention enables expansion of the color gamut covered by the display. Second, 
the device in accordance with the invention enables a significant increase in the 
luminous efficiency of the display; in some cases, an increase of about 50 percent or 
higher may be achieved, as discussed below. This feature of the invention is particularly 
advantageous for portable (e.g., battery-operated) display devices, because increased 

15 luminous efficiency may extend the usable time of a battery after each recharging and/or 
reduce the overall weight of the device by using a lighter battery. Third, a device in 
accordance with the invention enables improved graphics resolution by efficient 
utilization of a technique for arranging primary colors in sub-pixels, as described in 
detail below wifli reference to specific embodiments of the invention. 

20 In some multi-primary display devices in accordance with embodiments of the 

invention, more tihan three sub-pixels of different colors are used to create each pixel. In 
embodiments of thei invention, the use of four or more different color sub-pixels, per 
pixel, allows for a wider color gamut and higher luminous efficiency. In some 
embodiments, the number of sub-pixels per pixel and the transmittance spectriun of the 

25 different sub-pixel filters may be optimized to obtain a desired combination of a 
sufficiently wide color gamut, sufficiently high brightness, and sufficiently high 
contrast. 

For example, the use of more than three primaries in accordance with an 
embodiment of the invention may enable expansion of the reproducible color gamut by 
30 enabling the use of filters with narrower transmission curves (e.g., narrower effective 
transmission ranges) for the R, G and B color filters and, thus, increasing the saturation 
of the R, G and B sub-pixels. To compensate for such narrower ranges, in some 
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embodiments of the invention, broader band sub-pixel filters may be used in addition to 
the RGB saturated colors, thus increasing the overall brightness of the display. In 
accordance with embodiments of the invention, an optimal combination of color gamut 
v^dth and over-all picture brightness can be achieved, to meet the requirements of a 
5 given system, by appropriately designing the sub-pixel filters of the n-primary display 
and the filter arrangement 

Fig. 5A and 5C schematically illustrate transmission curves for two, respective, 
alternative designs of a five-primary display device in accordance with embodiments of 
the invention, wherein the five primary colors used are red (R), green (G), blue (B), cyan 

10 (C) and yellow (Y), denoted collectively RGBCY. Figs. 5B and 5D schematically 
illustrate the resulting color gamut of the filter designs of Figs. 5 A and 5C, respectively. 
It will be appreciated that both designs produce wider gamut coverage and/or higher 
brightness levels than corresponding conventional three-color LCD devices, as discussed 
in details below. As known in the art, the normalized over-all brightness level of a 

1 5 conventional 3-color LCD may be calculated as follows: 

Y(3^colors) = (Y(colori) + Y(color2) + Y(color3)) / 3 

In an analogous maimer, liie normalized brightness level of a 5-color LCD device 
in accordance with an embodiment of the present invention may be calculated as 
follows: 

20 Y(5-colors) = (Y(colori) + Y(color2) + Y(color3) + Y(color4) + YCcolors) )/5 

wherein Y(colori) denotes the brightness level of the i'th primary color and Y(n-colors) 
denotes the over-all, normalized, brightness level of the n-primaries display. 

Although the color gamut illustrated in Fig. 5B is comparable with that of a 
corresponding 3-color LCD device (Fig. 4B), the brightness level that can be obtained 

25 using the filter design of Fig. 5A is about 50% higher than that of the corresponding 
3-color LCD. The higher brightness levels achieved in this embodiment are attributed to 
the addition of yellow (Y) and cyan (C) color sub-pixels, which are specifically designed 
to have broad transmission regions and, thus, transmit more of the back-illumination 
than the RGB filters. This new filter selection criterion is conceptually different from the 

30 conventional selection criteria of primary color filters, which are typically designed to 
have narrow transmission ranges. The white point chromaticity coordinates for this 



15 



BNSDOCID: <WO 03088203A1_I_> 



wo 03/088203 PCT/IL03/00307 

embodiment, as calculated jfrom the transmission spectra and the back-illununation 
spectra using methods known in the known art, are x=0.3 1 8; y=0.352. 

As shown m Fig. 5D, the color gamut for the filter design of Fig. 5C is 
considerably wider than that of tibe corresponding conventional 3-color LCD (Fig. 4B), 
5 even wider than a corresponding NTSC gamut, which may be the reference gamut for 
color CRT devices, with brightness levels roughly equal to those of a 3-color LCD. In 
this embodiment, the over-all brightness level of the 5-color LCD device may be similar 
to that of a 3-color LCD device having a much narrower color gamut. The white point 
coordinates for this embodiment, as calculated from the transmission spectra and the 

10 back-illiomination spectra using methods known in the known art, are x=0.3 10; y=0.343 . 

Other designs may be used in embodiments of the invention, including the use of 
different primaries and/or additional primaries (e.g., 6 color displays), to produce higher 
or lower brightness levels, a wider or narrower color gamut, or any desired combination 
of brightness level and color gamut, as may be suitable for specific appUcations. 

15 Fig. 6 schematically illustrates a chromaticity diagram of the color gamut 

discemable by humans, divided into six sub-gamut regions, namely red (R), green (G), 
blue (B), yellow (Y), magenta (M) and cyan (C) color sub-gamut regions, that may be 
used for selecting effective color filters spectra in accordance with embodiments of the 
invention, hi some embodiments, more than three primary color filters, for example, five 

20 color filters as in tiie embodiments of Fig. 5 A may be selected to produce chromaticity 
values within respective sub-gamut regions in Fig. 6. The exact chromaticity position 
selected for a given primary color witMn a respective sub-gamut region may be 
determined in accordance with specific system requirements, for example, the desired 
width of the color gamut in the chromaticity plane and the desired image brightness. As 

25 discussed in detail above, the system requirements depend on the specific device 
application, e.g., certain applications give preference to gamut size, while other 
applications give preference to image brightness. The sub-gamut regions in Fig. 6 
represent approximated boundaries from which primary colors may be selected to 
provide large gamut coverage and/or high brightness levels, while maintaining a desired 

30 white point balance, in accordance with embodiments of the invention. The positions of 
the primary chromaticity values within the sub-gamut regions of Fig. 6, for given filter 
spectra selections and known back-illumination spectra, can be calculated using 

16 



BNSDOCID: <WO ^03088203A1_L> 



wo 03/088203 PCT/IL03/00307 

straightforward mathematical calculations, £is are known in the art, to determine whether 
a desired color gamut is obtained for the given filter spectra selections. 

In accordance with embodiments of the invention^ a multi-primary display with n 
primary colors may include an array of pixels, each pixel including n sub-pixels, 
wherein each sub-pixel has a predetermined aspect ratio, for example, n:l, which yields 
a desired aspect ratio, for example, 1:1, for each pixel. 

The sub-pixels in each pixel may be configmed in a one-dimensional or a 
two-dimensional array. Figs. 7A, 7B and 7C illustrate one-dimensional coirfigurations of 
sub-pixels in a pixel of an n-primary LCD display in accordance with exemplary 
embodiments of the invention. The configurations illustrated in Figs. 7A, 7B and 7C are 
one dimensional in the sense that all the sub-pixels of each pixel are configured in a 
single linear sequence. 

If n is not a prime number, i.e., if n=l*k wherein k^^l and l^^l are integers, it is 
possible to configure the sub-pixels in two-dimensional configurations, e.g., in 1 rows 
and k columns. Figs. 7D and 7E schematically illustrate two-dimensional configurations 
of sub-pixels in a pixel of an n-primary LCD display, in accordance witii exemplary 
embodiments of the invention. 

For example, as shown in Figs. 7A-7E, sub-pixels of a 5-primary display may 
have a one-dimensional configuration 702, whereas sub pixels of 4-primary or 6-primary 
displays may be configured either in one-dimensional configurations, e.g., 701 and 704, 
respectively, or in two-dimensional configurations, e.g., 703 and 705, respectively. 

According to embodiments of the invention, some of the attributes of an 
n-primary LCD display may be related to the arrangement of the n sub-pixels forming 
each pixel as described hereinafter. Such attributes may include, for example, image 
resolution, color saturation, viewed luminance uniformity, and/or any display attribute 
that may be affected by sub-pixel arrangements described herein. 

According to an exemplary embodiment of the invention, desired color saturation 
may be achieved by arranging the n primary colors forming each pixel based on a hue 
order of the individual n primary colors. In this context, the hue order may be based on 
the cncumferential sequence of the individual n primary colors on a chromaticity 
diagram, for example, the horseshoe diagram illustrated in Fig. IB. Light of each display 
sub-pixel may be transmitted through a corresponding color filter. However, due to light 
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scattering and reflection effects, liie light may also "leak" throtigh the color fQters of 
neighboring sub-pixels. This may result in distortion or reduction of the desired color 
saturation. For example, if neighboring sub-pixels reproduce complementary primary 
colors, light leakage between the sub-pixels may reduce the effective color saturation of 
5 the sub-pixels due to a certain degree of neutral-color viewed from the combination of 
complementary colors. It should be noted that the effect of light leakage from one 
sub-pixel to another may depend on the length of the border between the sub-pixels as 
well as the distance between the sub-pixels, e.g., the leakage of light may be reduced as 
the distance between the centers of neighboring sub-pixels is increased. For example, 

10 vertically or horizontally neighboring sub-pixels, e.g., on the same row or on the same 
column, may be more susceptible to leakage than two diagonally neighboring sub-pixels. 
Fxnihermore, neighboring pixels on rows and colxmms may produce different leakage 
effects depending on the aspect ratio of the sub-pixels. 

In order to avoid the viewed leakage effect described above, arrangements of 

15 sub-pixels according to exemplary embodiments of the invention may be designed to 
maximize the distance between sub-pixels of complementary primary colors and/or 
pardy complementary sub-pixels. An arrangement of sub-pixels according to hue order 
in accordance with exemplary embodiments of the invention may minimize the effect of 
light leakage from one sub-pixel to another and, thus, increase the color saturation and 

20 minimize distortion of entire pixels. 

Figs. 8A and 8B schematically illustrate arrangements 801 and 802, respectively, 
of primary colors in sub-pixels based on the hue order of primary colors, for a 
one-dimensional 5-primary display and for a two-dimensional 4-primary display, 
respectively, in accordance with exemplary embodiments of the invention. The 5 

25 sub-pixels in arrangement 801 of the 5-primary display are arranged according to hue 
order, e.g., RYGCB. This arrangement implies that potential leakage of light from each 
sub-pixel to a neighboring stib-pixel may only slightly shift the hue of the color 
represented by the entire pixel withoiit significantly affecting the color saturation of the 
pixel. It will be appreciated that, in contrast to arrangements 801 and 802, for example, 

30 if tiae yellow and blue colors were to be arranged in neighboring sub-pixels, such as in a 
RYBGC arrangement, even a small light leakage from one sub-pixel to a neighboring 
siib-pixel would have caused a large reduction in saturation of the entire pixel. In the 
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exemplary case of the two-dimensional arrangement 802 of the 4-primary display, the 
blue and yellow sub pixels are located on one diagonal and the red and green sub-pixels 
are located on another diagonal, thus creating an arrangement wherein each color 
sub-pixel directly neighbors only sub-pixels with relatively close hues, e.g., the yellow 
5 color sub-pixel may directly neighbor the red and green color sub-pixels. It should be 
noted that the exemplary arrangements shown and described herein are demonstrative 
only. It will be appreciated by persons skilled in the art that other suitable arrangements 
of the sub-pixels, wherein each sub-pixel neighbors other sub-pixels based on hue 
valvies, are also within the scope of the invention. 

10 According to another exemplary embodiment of the invention, to improve the 

viewed spatial uniformity of an image, viewed variations in the brightness of a spatially 
uniform image may be reduced by appropriately arranging the n primary color 
sub-pixels internally within each pixel, as follows. 

According to exemplary embodiments of the invention, an array of pixels 

15 forming the LCD display may be broken-down into a plurality of identical basic 
repeating units. A basic repeating unit may contain a configuration and/or arrangement 
of one or more pixels, or a predefined combination of sub-pixels, which is repeated 
throughout the array of sub-pixels forming display. Figs, 9A and 9B illustrate 
arrangements of sub-pixels including a basic repeating unit in a RGB LCD display, in 

20 accordance with exemplary embodiments of the invention. In a conventional 
arrangement 901 of pixels of a RGB LCD display, for example, a red sub-pixel may 
occupy the same position in different rows, such lhat the ord^ of sub-pixels in each row 
may be R-G-B, The basic repeating unit in this exemplary arrangement represents one 
RGB pixel 902. In another exemplary RGB arrangement 903, a first row of the display 

25 may include R-G-B sub-pixel arrangements, a second row may include B-R-G sub-pixel 
arrangements, a third row may include G-B-R sub-pixel arrangements, and a forth row 
may again include the R-G-B sub-pixel arrangements. In this case, a basic repeating unit 
904 may include three pixels, one directly below the other. 

A similar approach may be used for a more-than-three primary display wherein 

30 the sub-pixels are configured in one-dimensional or two-dimensional configurations as 
described above. For a two dimensional sub-pixel configuration, the relationships 
between sub-pixel colors in neighboring pixels on dijfferent rows as well as the 
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relationships between sub-pixel colors in neighboring pixels of the same row may be 
analyzed in an analogous manner. 

Fig. 9C schematically illustrates aa arrangement 905 of sub-pixels including a 
bagic repeating unit 906 having a one-dimensional S-primary configuration in 
5 accordance wilh an exemplary embodiment of the invention. 

Luminance values of the primary colors may depend on a set of primary color 
filters and the type of backlight used by the display. Different filters and light sources 
may provide different primary color luminance values; therefore, the methods described 
herein for arranging the sub-pixels may )deld sub-pixel arrangements for achieving 

10 optimal luminance uniformity for a given combination of backlight and filters. 

According to an exemplary embodiment of the iavention, a 5-primary display 
may include a set of five primary colors, denoted PI, P2, P3, P4 and P5, having 
luminance values of, for example, 0.06, 0.13, 0.18, 0.29 and 0.34, respectively. 
According to this exemplary embodiment of the invention, there may be 24 different 

15 one-dimensional arrangements of the primary colors. To determine an optimal 
arrangement of the sub-pixels, in an embodiment of the invention, a fimction 
transforming spatial coordinates to spatial fi-equencies, e.g., harmonics, for example, a 
Fourier Transform ,inay be applied to each arrangement, and the amplitude of the first 
harmonic of the transformation may be analyzed as a criterion for choosing an optimal 

20 arrangement. For example, a Fourier Transform analysis as described with reference to 
Fig. 10 below indicates that a relatively low first harmonic amplitude may be obtained 
for an arrangement of the 5 primary colors in unit 906 in the order P2-P3-P4-P1-P5, as 
shown schematically in Fig. 9C, as well as for an arrangement of the primary colors in 
liie order P2-P5-P1-P4-P3 (not shown). According to this exemplary embodiment of the 

25 invention, either one of the optimal arrangements, namely, P2-P3-P4-P1-P5 or 
P2-P5-P1-P4-P3, may be chosen to optimize further required display attributes, e.g., 
image brightness, color saturation, image resolution, or any other relevant display 
attribute. 

Fig. 10 is a schematic block-diagram illustrating a method for arranging n 
30 primary color sub-pixels within a pixel of a LCD display in accordance with exemplary 
embodiments of the invention. 
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The method may include mapping all possible arrangements of the n primary 
colors to the n sub-pixels for a selected sub-pixel coniiguration, as indicated at block 
1001. 

As indicated at block 1002, the known luminance values of each of the primary 
5 colors axe used to calculate a set of limiinance values as a function of sub-pixel position 
for each of the mapped sub-pixel arrangements of block 1001. 

As indicated at block 1003, a transformation function, for example, a Fourier 
Transform of the position-dependent luminance values calculated at block 1002, may be 
calculated. 

10 Since the eye is more sensitive to contrast variations at low spatial frequencies, 

the amplitude of the first harmonic of the transform may be analyzed for all 
arrangements, to select arrangements with a relatively small amplitude of the first 
harmonic, as indicated at block 1004. 

According to altemative embodiments of the invention, block 1004 may include 

15 further optimization techniques, for example, since the sensitivity of the eye may be 
different in different directions, the selection of an optimal arrangement may also be 
based on the direction of variation of the first harmonic. 

According to exemplary embodiments of the invention, a computer rurming 
suitable software, or any other suitable combination of hardware and/or software, may 

20 be used to perform tiie method described above. 

According to a fiirliier embodiment of the invention, the primary colors may be 
arranged in sub-pixels in a combination wherein each sub-set of neighboring sub-pixels 
within a pixel may have a substantially neutral white-balance, i.e., each sub-set may be 
capable of produciug light as close as possible to white light. An advantage of this 

25 arrangement is that it may enable high-resolution rendering of black-and-white images, 
for example, images of characters, e.g., black text over white background. 

Figs. 11 A and IIB illustrate an assignment of primary colors to sub-pixels, 
wherein each sub-set of neighboring sub-pixels within a pixel may have a relatively 
neutral white-balance, in accordance with an exemplary embodiment of the invention. 

30 In the 5-primary one-dimensional configuration illustrated in Fig. 11 A, the 

primary color sub-pixels are arranged in a RGBYC arrangement 1 101, including RGB, 
GBY, B YC, YCR and CRG triad sub-sets. 
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Fig. lie is a schematic illustration of a chromaticity diagram representing a 
color gamut of a 5 -primary display in accordance with an exemplary embodiment of the 
invention. It will be appreciated that tite color gamut produced by each of the triads 
listed above includes an area 1104, which contains a D65 white point 1103, and thus 
5 may produce light very close to white light Therefore, the arrangement of sub-pixels 
according to arrangement 1101 may increase the effective luminance resolution of the 
display by a factor of 5/3 compared to the luminance resolution that may be achieved by 
a 5-primary display without the specific sub-pixel arrangement described herein. In the 
6-primary two-dimensional configuration illustrated in Fig. IIB, arrangement 1102 of 

10 the primary colors is preformed for two neighboring pixels, wherein the first row may 
include the combination RGBCMY and the second row may include the combination 
CMYRGB. Each combination includes the triads RGB and CMY, which may each 
produce substantially white light. This arrangement further creates in each one of the 
columns desirable sub-combinations, e.g., sub-pixel pairs RC, GM and YB. These 

15 sub-combinations may include pairs of complementary colors, which may each produce 
substantially white light. It will be appreciated that the arrangement of Fig. 1 IB may 
increase the resolution of the display by a factor of about 3 in the horizontal direction 
and by a factor of about two in the vertical dhrecdon compared to a luminance resolution 
achieved by a 6-primary display without the sub-pixel arrangements described herein, 

20 Another embodiment of the invention relates to a method of n-primary sub-pixel 

rendering of a displayed graphic object, for example, a character of a text font. When 
displaying a graphic object on a screen, resolution may be an important factor, especially 
when extrapolation or interpolation methods are used to resize graphic objects to a given 
screen resolution. For example, when a relatively small graphic object is enlarged, using 

25 up-scaling methods as are known in the art, to display a relatively large image of the 
graphic object, the clarity of the enlarged image may be impaired because of inaccurate 
extrapolation of data to create new pixels. This problem may be particularly apparent at 
or near the edges of a displayed graphic object, e.g., along the contour of the graphic 
object. 

30 Fig. 12A illustrates an enlargement of the letter "A" when rastered to be 

displayed using black and white pixels. The letter illustrated in Fig. 12A may not be 
easily readable because of its low resolution. 
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Fig. 12B illustrates an enlargement of the letter "A" using gray-scale pixel 
rendering. 

In order to improve tJie resolution and readability of monochromatic, 
high-contrast images, e.g., a black graphic image on white background, a gray-scale 
5 pixel rendering method may be used. A gmy-scale pixel rendering method may include 
sampling each pixel of a pixel-matrix representation of the image to determine a 
percentage of the pixel-area covered by the graphic object for each partly-covered pixel 
and reproducing the pixel with a gray-level responsive, e.g., proportional, to the 
percentage of the pixel area covered by the graphic object A drawback of this method 

10 may be a fuzziness of the object as shown id Fig. 12B. 

An improvement of graphic object rendering may include sub-pixel rendering. 
Sub-pixel rendering for a LCD display may utilize a sub-pixel matrix instead of a 
full-pixel matrix. Fig. 12C illustrates an enlargement of the letter "A" as produced by 
RGB sub-pixel rendering techniques. As shown in Fig. 12C, each pixel is composed of 3 

15 sub-pixels, whereby the rendering may be carried out separately for each sub-pixel. This 
method may allow improved readability compared to the full-pixel rendering methods. 
However, this method has a drawback of color fringes effects, which may result from 
Ixraiinance variation between neighboring sub-pixels, e.g., a sub-pixel covered by the 
graphic object may have a luminance level different from a neighboring sub-pixel not 

20 covered by the object. This problem may be particularly apparent at or near the edges of 
a displayed graphic object, e.g., along the contour of the graphic object- 
According to an exemplary embodiment of the invention, a method for 
minimizmg color fringes may be applied to a given sub-pixel configuration, for example, 
five-primary one-dimensional arrangement 1101 (Fig. 11 A), or to any other 

25 one-dimensioned or two-dimensional configuration, as described in detail below. 

Reference is made to Fig. 12D, which schematically illustrates an enlargement of 
an upper part of the letter "A" using n-primary sub-pixel rendering according to 
exemplary embodiments of the invention, and to Fig. 12E, which schematically 
illustrates a table showing initial coverage values that may be assigned to sub-pixels of 

30 the image of Fig. 12D using an assigimient method according to exemplary 
embodiments of the invention. 
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According to exemplary embodiments of the sub-pixel rendering method of the 
invention, each sub-pixel may be assigned with an initial coverage value, which may be 
related, e.g., proportional, to the percentage of the sub-pixel area covered by the graphic 
object, as illustrated schenMtically in Figs. 12D and 12E. 
5 Reference is also made to Fig. 12F, which schematically illustrates an 

enlargement of an upper part of the letter "A" using sub-pixel rendering according 
exemplary embodiments of the invention, and to Fig. 12G, which schematically 
illustrates a table showing adjusted coverage values that may be assigned to sul>pixels 
of the image of Fig. 12F based on an assignment method according to exemplary 

10 embodiments of the invention. 

According to exemplary embodiments of the sub-pixel rendering method of the 
invention, an adjusted coverage value may be assigned to each of three sub-pixels, 
composing a pre-defined triad, based on a predetermined smoothing function, for 
example, a weighted average. The smoothing function may be used to reduce or 

15 eliminate variations in the initial coverage values of the different sub-pixels composing 
each sub-pixel triad. By adjusting the brightness of the sub-pixel in accordance with the 
adjusted coverage values, a substantially color-neutral luminance, e.g., a gray color, may 
be viewed throughout the image, and particularly along the contour of the graphic 
object, as described below. 

20 According to an exemplary embodiment of the invention, the smoothing function 

may include a weigjited average, wherein predetermined wei^ts are assigned to the 
sub-pixels of the triad, for example, a weight of 1 may be assigned to each sub-pixel in 
the triad. According to one exemplary embodiment of the invention, an adjusted 
coverage value 1210 assigned to sub-pixel 1201 may be determined by averaging initial 

25 coverage value 1204 of sub-pixel 1201 and initial coverage values 1202 and 1206 of 
neighboring sub-pixels 1205 and 1203, respectively. According to this exemplary 
embodiment, sub-pixel 1201 may be assigned an adjusted coverage value of 1/6, which 
corresponds to a weighted average of a set of initial coverage values of the triad 
containing sub-pixel 1201, for example, initial coverage values (0, 0, 0.5). According to 

30 another exemplary embodiment of the invention, sub-pixel 1203 may be assigned an 
adjusted coverage value 1212 corresponding to a weighted average of initial coverage 
values 1204, 1206 and 1208 of sub-pixels 1201 and 1203 and 1207, respectively. 
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According to this exemplary embodiment, sub-pixel 1203 may be assigned an effective 
coverage value of 1/3, which corresponds to a weighted average of a set of initial 
coverage values of the triad containing sub-pixel 1203, for example, coverage values (0, 
0.5, 0.5). 

5 According to further embodiments of the invention, the weighted average may 

include assigning a different weight to each sub-pixel. 

According to exemplary embodiments of the invention, there may be n different 
triad anrangements for a one-dimensional n-primary configxnration. Thus, according to an 
exemplary embodiment of the invention, n different weighting functions may be defined 

10 to allow calculating an adjusted coverage value for each sub-pixel of the arrangement, 
e.g., airangement 1101 (Fig. 11 A). 

According to another embodiment of the invention, a method for minimizing 
color fringes may be applied to a six primary, two-dimensional arrangement, e.g., 
arrangement 1102 (Fig. IIB), or to any other two-dimensional configuration. The 

15 method may include using a smoothing ftmction for assigning an adjusted coverage 
value to each sub-pixel of the triads composing a row and to each sub-pixel of the pairs 
composing a column as described above. According to exemplary embodiments of the 
invention, there may be 2n different arrangements available in a two-dimCTsioixal 
n-primary display. Thus, according to an exemplary embodiment of the invention, 2n 

20 different smoothing functions may be pre-defined to allow calculating an adjusted 
coverage value for each sub-pixel of the two-dimensional arrangement. 

Fig. 13 A is a schematic block illustration of a method for multi-primary 
sub-pixel rendering in accordance with exemplary embodiments of the invention. The 
method of Fig. 13A may allow sub-pixel rendering with enhanced resolution and 

25 enhanced readability, while minimizing color fiinge effects. This may be achieved by 
monitoring the contour and/or edges of a viewed graphic object. 

As indicated at block 1301, the method may include, according to embodiments 
of the invention, sampling a two-dknensional graphic object at sub-pixel resolution and 
assigning an initial coverage value to each sub-pixel according to tlie corresponding 

30 relative coverage of the graphic object. For example, if the graphic object covers 50% of 
a certain sub-pixel, then the sub-pixel mayJDe-assigned an initial coverage value of 0.5. 
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As indicated at block 1302, the method according to embodiments of the 
invention may include calculating a smoothing function, for example, a running 
weighted average, i.e., a continual re-calculation, of the initial coverage values of 
sub-pixel triads. 

5 As indicated at block 1303, an adjusted coverage value may be assigned to each 

sub-pixel according to the result of the smoothing function applied at block 1302. 

Fig. 13B is a schematic block diagram illustrating the flow of data in a system for 
sub-pixel rendering in accordance with exemplary embodiments of the invention. 

According to embodiments of the invention, the sub-pixel rendering system may 
10 include receiving an input corresponding to a graphic object from a suitable application 
software 1310, for example, a word-processing software. The system may further 
include a graphic interpreter 1320, a sub-pixel rendering unit 1330, a video card frame 
bviffer 1340, and an n-primary display 1350, which may include any type of 
more-than-three primary color display, for example, an n-primary color LCD display 
15 according to embodiments of the invention. 

Application software 1310 may be used to define graphic objects, e.g., text 
characters, and their size and position. 

Graphic interpreter 1320 may be used to translate the text and/or other graphic 
objects defined by application software 1310 into continuous two-dimensional objects, 
20 the contours of which may be defined by simple curves. 

The two-dimensional graphic objects may be processed by sub-pixel rendering 
unit 1330, which may sample the graphic objects at the sub-pixel resolution of the 
display, to obtain a relative coverage at each sub-pixel, and may apply a smoothing 
ftmction, as discoissed above, to provide a smooth bitmap defining the image to be 
25 displayed. 

The bitmap provided by sub-pixel rendering unit 1330 may be temporarily stored 
in graphic card frame buffer 1340 and may be further transferred and displayed on 
n-primary display 1350. 

In TV applications, text and graphic information may appear in the form of 
30 sub-titles, closed captioning, or TELETEXT signals. In digital TV application, this 
information may be included in a broadcast MPEG-fermat, and may be decoded by a 
MPEG decoder, for example, by a set-off box or a DVD player. According to 
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embodiments of the invention, a data flow system supporting sub-pixel rendering as 
described herein may be used to support fiitxjre applications of digital TV, for example, 
interactive text and graphics presentations. 

According to another embodiment of the invention, the n-primary color 
5 arrangements described above may be used to display a wider range of gray levels 
compared to a RGB LCD display. 

A pre-defined bit deptih of size bd may yield a range of 2^^ gray levels for each 
one of the primary colors xised in a display, e.g., an 8-bit depth may yield 256 
gray-levels for each primary color. In conventional RGB LCD displays, a combination 

10 of all 3 primary colors is used in order to display most colors, or to adjust the gray-level 
of a given color. Therefore, the maximum number of gray-levels for each displayed 
color depends on the bit-depth, e.g., 256 gray levels, numbered 0 to 255, for an 8-bit 
depth, wherein levels 0 and 255 correspond to black and white, respectively. In such a 
display, the brightest displayable white may be obtained using level 255 for all three 

15 primaries. In a similar manner, the darkest displayable gray is obtained when all three 
primary-color sub-pixels are activated at level 1 . 

Since the pixels of an input image may include a wider range of gray-levels, i.e., 
a larger bit-depth, for example, a 10-bit depth, many gray-levels may not be reproducible 
by existing displays. This problem may be particularly significant at low gray levels. 

20 Embodiments of the present invention may expand tiie reproducible bit-depth of a 
displayed image in a more-than-fhree primary display, for example, to a bit-depth of 
more than 8 bits, by reproducing additional gray-levels using combinations of only some 
of the sub-pixels in certain pixels or repeating xmits. This aspect of the invention may be 
advantageous in producing low gray-level pixels, because the variety of gray-levels may 

25 be particxilarly significant for the lower gray-levels. 

According to exemplary embodiments of the invention, a more-than-three 
primary color sub-pixel arrangement, for example, 6-primary RGBMCY sub-pixel 
arrangement 1102 (Fig, 11 A), wherein each sub-pixel has an 8-bit depth, may enable 
reproduction of an expanded gray-level range, e.g., a range of more than 256 gray levels. 

30 For example, several different sub-pixel combinations of arrangement 1 102 may be used 
to display a substantially white color using sets of sub-pixel pairs or triads as-described 
in detail above. Thus, sub-pixel airangements in accordance witii the invention, for 
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example, arrangement 1102, may enable displaying a substantially white color without 
using all primary color sub-pixels, e.g., using only part of the sub-pixels of a displayed 
pixel or repeating unit. For example, in a display using arrangement 1 102, the brightest 
white may be provided by setting the value of each sub-pixel to 255, The darkest gray 
5 achievable by a full pixel, corresponding to 8-bit color depth, may be obtained by setting 
the luminance value of each sub-pixel to 1. However, darker grays may be achieved 
according to embodiments of the invention, for example, by setting the values of the 
RGB sub-pixels to 1 while concurrently setting the luminance values of the CMY 
sub-pixels to 0. Since, according to an exemplary embodiment of the invention, the RGB 

10 triad may have only about a third or less of the total brightness of RGBMCY 
arrangement 1102, the darkest gray created by the RGB triad of arrangement 1102 may 
be darker than the darkest level of gray obtained by exciting all sub-pixels. Thus, by use 
of different triad combinations, according to exemplary embodiments of the invention, 
the displayable gray level range may be widened, e.g., by a factor of about 4, yielding an 

1 5 increase in bit-depth from about 8 to about 10. 

Although the above exemplary embodiments have been described for gray-level 
display, it will be appreciated by persons skilled in the art that the n-primary 
arrangements described above may also be used to produce an expanded bit depth, i.e., a 
wider range of gray-levels, for colors of different tints and hues. 

20 Fig. 14 is a schematic diagram of the flow of data in a LCD display system 

incorporatiag a method for expanding bit depth in accordance with exemplary 
embodiments of the invention. 

Reference is also made to Fig. 15, which schematically illustrates a chromaticity 
diagram representing the color gamut of a 6-pritnary display in accordance with an 

25 exemplary embodiment of the invention. 

The method of Fig. 14 may include receiving input data, as indicated at block 

1401. 

A first channel may be used to process the input data and to create an n-primary 
output as indicated at block 1402. 
30 For the 6 primary colors illustrated in Fig. 15, a selection of a triad of primary 

colors may define an effective field, e.g., effective field 1502 may be defined by a YMR 
triad. According to embodiments of the invention, in order to provide an expanded 

28 



BNSDOCID: <WO^__03088203A1_L> 



wo 03/088203 PCT/IL03/00307 

gray-level range for a desired color gamut, a triad of primary colors may be selected 
such that an effective field defined by the selected triad may include the desired color 
gamut, as explained in detail above. 

Referring again to Fig. 14, the input data may further be used to select a set of 
5 three primary colors corresponding to the effective field required to produce a desired 
gray level range and color gamut, as indicated at block 1403. An effective field may be 
defined by different color triads, e.g., effective field 1504 may be defined by triads RGB 
and YCM. Selection of the three primary colors firom a set of available triads defining a 
required effective field may include optimization of display attributes, for example, 
10 luminance xmiformity, smoothness, or any other objective, subjective or relative display 
attribute. 

As indicated at block 1404, a second channel may be used to process the input 
data based on the three-primary colors selected at block 1403. 

The Input data may be further used to calculate a combination parameter as 
15 indicated at block 1405, The combination parameter calculation may be based on 
providing a smooth display, a required level of brightness or any other related display 
attribute. For example, for a high luminance input, combining the channels may provide 
an output including substantially the mtilti-primary output of the first channel. For a 
low-luminance input, combining the channels may provide an output including 
20 substantially the 3-priniary output of the second channel. For a substantially medium 
luminance input, the output may include a combination of both chaimels. 

The first and second channels may be smoothly combined as indicated at block 
1406, as a fimction of the combination parameter calculated at block 1405. 

While certain features of the invention have been illustrated and described 
25 herein, many modifications, substitutions, changes, and equivalents vsdll now^ occur to 
those of ordinary sldll in the art. It is, therefore, to be understood that the appended 
claims are intended to cover all such modifications and changes as fall within the true 
spirit of the invention. 
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CLAIMS 

1 . A color display device for displaying aa n-primary color image, wherein n is 
greater than three, the device comprising an array of sub-pixels configured to 

5 have at least one repeating unit comprising one sub-pixel representing each of 

saidn primary colors, wherein the repeating unit is configiured to optin^ze at 
least one attribute of the n-primary color image. 

2. A color display device according to claim 1 comprising an n-primacy color 
Liquid Crystal Display (LCD) device, wherem said array of sub-pixels comprises 

10 an array of sub-pixel filter elements, each sub-pixel filter element transmitting 

light of one of said n primary colors. 

3 . A device according to claim 1 or 2 wherein said n primary colors comprise red, 
green, blue and yellow. 

4. A device according to claims 1-3 wherein said n primary colors comprise at least 
1 5 five dififerent primary colors. 

5. A device according to claim 4 wherein said at least five different primary colors 
comprise red, green, blue, yellow and cyan. 

6. A device according to claim 4 or claim 5 wherein said at least five different 
primary colors comprise at least six different primary colors. 

20 7. A device according to claim 6 wherein said at least six different primary colors 

comprise red, green, blue, yellow, cyan and magenta. 
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8. A device according to claims 1-7 wherein said sub-pixel elements are arranged in 
a one-dimensional array. 

9. A device according to claim 8 wherein said sub-pixel elements are arranged 
accordmg to a hue order of said n primary colors. 

5 10. A device according to claim 5 wherein said sub-pixels are arranged in a 

one-dimensional array in the order red, yellow, green, cyan and blue. 

1 1 .A device according to claim 8 wherein said sub-pixels are arranged in sub-sets, 
each sub-set comprising neighboring sub-pixels, whereiri each one of said 
sub-sets has a relatively neutral white-balance. 

10 12. A device according to claim 1 1 wherein each one of said sub-sets comprises 

three neighboring color sub-pixels. 

13. A device according to claim 12 wherein said sub-set comprises sub-pixels of five 
primary colors arranged in the order red, green, blue, yellow and cyan, 

14. A device according to claim 11 wherein each one of said sub-sets comprises two 
1 5 neighboring color sub-pixels. 

15. A device according to any of the preceding claims wherein each of at least some 
of said sub-pixels is activated in accordance with an adjusted coverage value 
determined by applying a smoothing function to initial coverage values of a 
group of less than n different primary color sub-pixels including each said 

20 activated sub-pixel. 
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16. A device according to claim 15 wherein said group of sub-pixels comprises two 
sub-pixels neighboring said color sub-pixel, said two sub-pixels located on one 
row. 

17. A device according to claims 1-3 or 6-7 wherein said sub-pixels are arranged in a 
5 two-dimensional array comprising a plurality of rows and columns. 

1 8. A device according to claim 1 7 wherein said sub-pixels are arranged according to 
a hue-order of said n primary colors. 

19. A device according to claim 1 8 wherein said two-dimensional array is a 
two-by-two array comprising red, yellow, blue and green color sub-pixels, said 

10 red and green primary sub-pixels located on a first diagonal of the 

two-dimensional array and said blue and yellow primary sub-pixels located on a 
second diagonal of the two-dimensional array. 

20. A device according to claim 17 wherein said sub-pixels are arranged in sub-sets, 
each one of said sub-sets capable of producing a relatively neutral white-balance. 

15 21 .A device according to claim 20 wherein each one of said sub-sets comprises 

three neighboring color-sub-pixels located on one row. 

22.A device according to claim 20 wherein each one of said sub-sets comprises two 
neighboring color-sub-pixels located on.one column. 

23 .A device according to claim 20 comprising six primary color sub-pixels arranged 
20 in &st and second rows, said first row comprising color sub-pixels in the order 
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red, green, blue, cyan, magenta and yellow, and said second row comprising 
color sub-pixels in the order cyan, magenta, yellow, red, green and blue. 

24 -A device according to claim 17 wherein each of at least some of said sub-pixels 
is activated based on an adjusted coverage value determined by applying first 
5 and second smoothing functions to initial coverage values of first and second 

groups of sub-pixels, respectively, containing each said activated sub-pixel, each 
of said first and second groups of sub-pixels including less than n different 
primary color sub-pixels. 

25. A device according to claim 24 wherein said first group comprises two 
1 0 sub-pixels in a single row including each said activated sub-pixel. 

26. A device according to claim 24 or 25 wherein said second group comprises at 
least one neighboring sub-pixel on the same column as each said activated 
sub-pixel. 

27. A device according to claim 1 or 2 wherein said repeating unit comprises an 
1 5 arrangement of said sub-pixels that opthnizes at least one property of said 

displayed image. 

28. A device according to claim 27 whereia the airangement of said sub-pixels is 
selected based on minimizing a harmonic of a transformation function applied to 
luminance values of a group of possible sub-pixel arrangements. 

20 29. A device according to claim 28 wherein said transformation function comprises a 

Fomier Transform and wherein said harmonic comprises a first harmonic of said 
Fomier Transform. 
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30. A device according to any of the preceding claims wherein said at least one 
attribute comprises a gray-level range of said repeating unit. 

3 1 .A device according to any of the preceding claims wherein said at least one 
attribute comprises color saturation. 

5 32.A device according to any of the preceding claims wherein said at least one 

attribute comprises luminance uniformity. 

3 3. A device according to any of the preceding claims wherein said at least one 
attribute comprises image resolution. 

34. A device according to any of the preceding claims wherein said at least one 
10 attribute comprises a property related to a color fringes effect. 

3 5. A method of displaying a color image on a color display comprising an array of 
sub-pixels configured in a plurality of repeating units of at least one type each 
repeating unit including a sub-pixel of each of n different primary colors, 
wherein n is greater than three, the method comprising producing a color 

15 combination by at least one of said repeating units without activating a sub-set of 

sub-pixels capable of producing substantially white light in the repeating unit 
producing said color combination. 

3 6. A method of displaying a color image on a color display comprising an array of 
sub-pixels including a plurality of sub-pixels of each of n different primary 
20 colors, wherein n is greater than three, the method comprising: 
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determining initial coverage values for a group of less than n diEPerent 
primary color sub-pixels containing each of at least some of said sub-pixels; 

determining an adjusted value for each of said at least some sub-pixels by 
applying a smoothiag function to said initial coverage values; and 

activating each of said at least some sub-pixels iti accordance with said 
adjusted coverage value. 
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